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I.  Introduction. 


Let  {Xn;  n  >  1}  be  an  i.i.d.  sequence  of  random  variables  (r.v. ’s)  defined  on 
some  probability  space  (ft,A,P)  with  a  c.d.f.  F  such  that  either  F(x)  <  1,  all 
x,  or  the  right  end  xm  =  sup  (x  e  R  ;  F(x)  <  1}  is  not  an  atom  of  F.  Then  the 
associated  record  times  {Un;  n  _>  0}  and  inter-record  times  {An;  n  >  0}  given  by 

n 

V1,  An+l=inf  {k;  \j  +k  >  }  where  Un  =klQ  Ak’  n  1  °»  (1.1) 

are  a.s.  well-defined  (see  Shorrock  (10)).  A  large  number  of  exact  and 
asymptotic  results  for  these  sequences  has  been  given  in  the  literature,  e.g. 
by  Renyi  (8)  who  stated  that  the  record  times  form  a  homogeneous  Markov  chain 
with  transition  probabilities 

p(un+rklun=j)  =  kTiTTF  >  n>0,  (1.2) 

independent  of  F,  in  case  that  F  is  continuous  (which  we  shall  assume  in  what 
follows).  He  also  proved  the  LLN,  CLT  and  LIL  for  record  times,  i.e. 


-  log  U 
n  6  n 


-*•  1  a.s.  (n  -*•  ®) 


(1.3) 


i  (log  U  -n)  N(0,1)  (n  -►  ») 

vfi  n 


(1.4) 


lim 


sup 

inf 


log  U  -  n 

n _ 

/2n  log  log  n 


+ 


a.s . 


(1.5) 


For  the  inter- record  time  sequence  it  was  shown  by  Shorrock  (10)  that  given  the 

record  value  sequence  ;  n  >  0},  the  inter-record  times  are  conditionally 

n 

independent  and  geometrically  distributed,  i.e. 

P(A  i«  klxu  1  ■  n-F(xu  )}  Fk'1(Xu  )  a.s.,  k  >  1,  n  >  0,  (1.6) 

n  n  n 


which  is  intuitively  clear  by  (1.1)  since  the  record  times  Un  are  stopping  times 
for  the  original  sequence  {Xn;  n  _>  1}.  from  this  observation  he  derived 


1 

/if 


-  log  A  ->-1  a.s. 
n  6  n 


(log  A  -n)  -*■  N(0,1) 


log  A  -  n 
Urn  SUP  — - — 2— — 
inf 


/2n  log  log  ii 


in  -  “) 

(n  ►  <") 


=  +  1  a.s. 


(1.7) 

(1.8) 

(1.9) 


which  are  the  LLN,  CLT  and  LIL  for  inter- record  times  (see  also  Neuts  (5)  and 

n 

Strawderman  and  Holmes  (12)).  The  fact  that  although  we  have  U  =  £  A,  ,  n  >  0, 

n  k=l  k 

the  same  normalizing  constants  appear  in  these  limit  laws  for  both  sequences 
makes  it  clear  that  e.g.  the  normal  approximation  (1.4)  and  (1.8)  cannot  be  very 
powerful  for  small  values  of  n.  This  was  already  pointed  out  by  Neuts  (5)  who 
suggested  that  n  should  be  at  least  as  large  as  1000  in  order  to  obtain  satis¬ 
factory  results.  This  will  also  be  discussed  in  this  paper  when  asymptotic 
evaluations  for  log  -  log  An  arc  investigated. 

Shorrock  (10)  also  pointed  out  that  the  sequence  {log  11  ;  n  ^  0}  should  be  close 
to  a  Poisson  point  process  in  some  sense  l sec  also  Resnick  (0)),  explaining  for 
the  limit  relations  (1..V)  to  (1.5).  \  constructive  approach  to  this  question  was 

made  by  Williams  (15)  and  Westcott  (14)  who  showed  that  if  {Y^;  n  _>  1 )  is  an 
i.i.d.  sequence  of  exponentially  distributed  r.v.'s  with  unit  mean,  then  the 
sequence  {U* ;  n  0}  defined  recursively  by 

U0  =  1’  un+i*  =  ,!,n*  0  M+l  1  •  (1.10) 


where  |.[  denotes  the  nearest  integer  not  less  than  the  real  number  specified, 
is  a  Markov  chain  with  the  same  distribution  as  {U  ;  n  >  0},  and 


3 


log  U*  =  l  Y.  +  0(1)  a.s.  (n  -  •») 
n  k=l  K 


For  a  refinement  of  this,  see  (7).  In  (6)  it  was  also  shown  that 


(1.11) 


r'.y.-f. 


E(log  Un)  =  n+l-C  +  0(2n) ,  Var(log  iy  =  n+l-g-  +  0(n32'n) 

2  ?  - 

E(log  A  )  =  n-C+0(n2  n) ,  Var(log  A^)  =  n+  ^—  +  0(nz2  n) ,  n  ®, 


(1.12) 


til 


where  C  =  .577216  denotes  Euler's  constant  and  Var  means  variance.  An  intuitive 
explanation  for  the  last  two  relations  is  due  to  the  strong  approximation 
approach  by  Deheuvels  (1,2)  who  proved,  starting  with  relation  (1.6),  that  on 
the  same  probability  space  (ft,A,P)  (possibly  after  enlarging)  there  exists  a 
Poisson  point  process  (T  ;  n  _>  1}  with  unit  rate  and  an  i.i.d.  sequence 
(V  :  n  >_  1}  of  unit  mean  exponential  r.v.’s,  independent  from  the  Poisson 
process,  such  that 


m 


log  An  =  log  Yn  +  Tn  +  0(1)  a.s.  (n  -*•  ®) 


(1.13) 


Here,  -log  Yn  is  doubly  exponentially  distributed  with  mean  C  and  variance 
2 

g-  .  In  fact,  Tn  =  -log(l-F(Xlj  )),  n  _>  1,  as  can  be  seen  from  Deheuvel's 

n- 1 

construction.  The  rate  of  convergence  in  (1.13)  was  precised  in  (7)  where  it 
was  shown  that 


v.-V-) 


log  An  =  log  Yn  +  +  o(exp(-n+nIly ))  a.s.  (n  -*•  °°)  (1.14) 


where  tH(i-)  belongs  to  the  upper  class  of  a  Wiener  process,  i.e.  H(t)  is  a 
positive  function  defined  in  some  positive  neighbourhood  of  the  origin  such 


that  H(t)  t  and  t  '  H(t)  I ,  and  the  integral 


I  =  t'3/2H(t)  exp  ( -H2 (t)/2t)  dt 


(1.15) 


/ -.VnV-.  ' 


•  J 


converges.  It  was  also  shown  that  this  rate  result  cannot  be  extended  to  lower 
class  fimctions  (i.e.  H  as  above  with  I  being  divergent 1 ,  not  even  if  o(.)  is 
replaced  by  0(.). 

Deheuvels  (11  also  gave  a  strong  approximation  result  for  record  times,  based  on 
the  one  derived  for  the  inter-record  times,  i.e.,  with  the  notation  of  (1.13), 


n-l 

. .  sup  ^n  ^k=-“  ^ke  - - 1 / 2 

lim  - =  +  .■>  a.s., 


inf 


/2n  log  log  n 


(1.16) 


where  now  the  index  range  for  the  sequences  involved  is  extended  to  / ,  and  also 
a  corresponding  CLT.  It  was  also  proved  that  this  strong  approximation  result 
is  best  possible  if  the  construction  based  on  (1.6)  is  used. 

It  is  the  aim  of  the  present  paper  to  develop  a  corresponding  strong  approximation 
(on  the  same  probability  space)  based  on  William's  approach  (1.10),  even  valid 
for  exchangeable  sequences  (Xn,  n  _>  1},  which  simplifies  (1.16)  and  at  the  same 
time  allows  for  a  joint  strong  approximation  of  record  and  inter-record  times, 
besides  the  limit  laws  mentioned  above,  also  Galambos'  and  Seneta's  (3)  results 
for  the  i.i.J.  case  are  easily  reobtained,  and  some  others,  including  exact 
estimations  for  the  rate  of  convergence  as  in  (1.1-1). 

In  fact,  it  is  easy  to  see  that  if  (Xn;  n  _>  1}  is  an  exchangeable  sequence  and 

the  probability  of  ties  is  zero  (i.e.  P(X^  =  X-,)=0) ,  then  again  record  and 

inter-record  times  can  be  defined  as  in  (1.1),  likewise  for  the  recond  values 

(X]|  >  n  ^  0}.  Namely,  by  de  Finetti's  theorem,  we  may  assume  that  there  exists 
n 

a  real  r.v.  A  on  (n,A,P)  such  that  conditionally  on  A  =  A  e  1R  ,  (X^;  n  >  1}  is 
an  i.i.d.  sequence  with  c.d.f.  F^,  say.  Now  since  ties  occur  with  probability 
zero  only  we  must  have  P(Xj  =  X2 1 A  =  X)  =0  P‘  -a.s.  which  in  turn  implies 
that  F^  is  continuous  for  P^-almost  all  X,  i.e.  given  A  =  X,  (1)^;  n  >  0}  is  a 


s 


Markov  chain  with  transition  probabilities  given  by  (1.2),  independent  of  X, 
for  -  almost  all  X.  Hence  under  exchangeability,  if  ties  occur  with  probability 
zero  only,  (Un;  n  ^  0}  and  (A^;  n  >  0}  are  a.s.  well  defined,  the  record  times 
forming  a  homogeneous  Markov  chain  with  transition  probabilities  given  by  (1.2) 
as  in  the  i.i.d.  case. 

Note  that  the  condition  of  zero  probabilities  for  ties  can  in  general  not 
be  replaced  by  a  continuity  assumption  on  the  marginal  distribution  (as  in  the 
i.i.d.  case)  as  can  be  seen  by  the  exchangeable  sequence  (Xn;  n  >_  1}  where 
7-  Xj  for  all  n  >  2.  Of  course,  in  the  case  of  independence,  these  two 
conditions  coincide. 

As  has  become  obvious  from  the  preceding  remarks,  all  relevant  information  on 
record  and  inter-record  times  is  contained  in  the  Markov  chain  with  transition 
probabilities  given  by  (1.2).  It  will  therefore  be  necessary  to  deal  with 
strong  approximation  techniques  for  Markov  chains  as  developed  in  the  following 
sect  ion. 


1 1 .  Strong  approximation  for  Markov  chains 

TjU-ORBl  1.  Let  { ;  n  >_  0}  be  a  real -valued  homogeneous  Markov  chain  on  the 
probability  space  (H,A,P)  with  =  constant  a.s.  and  regular  transition 
probabilities  (which  here  always  exist).  Let  further  denote  F(  . |.  )  the 
corresponding  conditional  c.d.f..  Then  there  exists  an  i.i.d.  sequence 
(V  ;  n  >  1}  of  uniformly  (/[0, 1 ] -distributed  r.v.'s  on  the  same  probability 
space  (eventually  after  enlarging)  such  that 

Sn+l  =  F~1(Vn+l!V  a-s-  fora11  n  0  (2-r 

where  F  *(v|.)  =  inffz|F(z|.)  >  v),  0  <  v  <  1  denotes  the  pseudo- inverse  of 
F(.|.). 


A-:- 

>.\V- 
*.  .-v 


v-:Cvv  >>>:'• vy-v 


PROOF.  Let  {W  ;  n  ^  1}  be  an  i.i.d.  sequence  of  U[0,1 1  -distributed  t.v.'s  on 
(0,A,P)  independent  of  (S^;  n  _>  0}  (which  eventually  exists  after  enlarging  the 
probability  space).  Let  further  denote 


F  (z|.)  =  lim  F(z-h|.),  z  e  IR  . 
InO 


r;-y-y 


He fine 


Vi  ’  n-'VP  *  h„.i  r-'Ws.h  "  i  »•  <2-3> 


Then  (V  ;  n  >  1}  is  an  i.i.d.  sequence  of  U{0,l]-distributed  r.v.’s  on  (f!,A,P) 
since  by  construction,  for  all  n  _>  0, 

P  . Sn<1)  U[F_(Sktl|Sk);  F(Sk.j|Sk)|  a.s.  (2.4) 

(where  in  the  degenerate  case,  U[z,z]  is  to  be  interpreted  as  the  Dirac 
measure  concentrated  in  z  e  IR ) ,  hence  by  integration, 


)  n 

P  n  1  =  ®  U[0,1]  for  all  n  >  0. 


Sn+1  -  f-  (Vn+1|Sn)  iff  F_(Sn+1|SJ  <  Vri+1  <  F(Sn+1|SJ 


-wnd'V  n+1  -  ‘  wn+l 1  n 


for  all  n  •>  0  which  by  (2.3)  holds  a.s.  This  completes  the  proof. 


\  st raight forward  generalization  to  non -homogeneous  or  higher-dimensional 
Markov  chains  is  obvious  from  the  preceding  proof  but  will  be  omitted  here. 
In  the  case  of  record  times,  we  have,  by  (1.2), 


F ( k | i )  =  1  -  £,  1  <  j  <  k, 


hence  by  (2.3), 


Vn+i  11  -  w  ir;r  +  Vi  u~r •  ni°- 

n+1  n+1 


.■  t 


f  i 

i  ’  fc  *  w  T 


r  V  V  V  |*  .  V' 


forma  an  i.i.d.  LI [0,1] -distributed  sequence  (here  we  have  used  the  fact  that 


with  V  also  1-V  is  d[0,l] -distributed) .  Further,  letting  =  -log  V  ,  n  1, 
we  obtain  an  i.i.d.  sequence  of  unit  mean  exponential  r.v.'s.  Theorem  1  thus 
translates  into  the  following  result. 


COROLLARY  1.  Without  loss  of  generality,  there  exists  an  i.i.d.  sequence 
{ Y  ;  n  >  1}  on  the  same  probability  space  where  (U^;  n  _>  0}  is  defined  which 
is  exponentially  distributed  such  that 


n+1, 


)  ,  u 

n+1  n 


Y 


a.s .  for  al 1  n  ^  0 

II  , 
n+1 


Li  '  V  ■  Vi  CT—nt 


1 


a.s.  for  all  n  >  0 


(2.9) 

(2.10) 


n+1  n+1 

where  Yn+J  =  -log  \'n+1  and  \'n+1 ,  h'n+1  as  in  (2.8) 


lo 


*  l!n+l  *  108  Un  •  Yn+1  =  lo* 


1  + 


W  , 
n+1 

U  .  -  1 
n+1 


a.s.  for  all  n  '  0  (2.11) 


=  | c  n+1[  a.s.  for  all  n  >  0,  (2.12) 

providing  an  i.i.d.  sequence  with  c.d.f.  given  by  F(.jl)  with  1:(.|.)  ns  in  (2.7) 

Relation  (2.12)  gives  a  simple  proof  for  the  main  result  in  Oalambos  and 
Sonet «  (a).  It  should  he  pointed  out  here  that  for  all  n  ^  0,  Y  j  and 
V  j  are  independent  from  (Uq,...,U  )  as  can  be  seen  from  the  recursive 
structure  in  (2.9). 


Relation  (2.11)  will  be  the  key  for  a  joint  strong  approximation  for  the 
logarithms  of  record  and  inter-record  times.  This  will  be  worked  out  in  more 
detail  in  the  following  section. 


and  { (T  -n)/vn;  n  ^  1}  arc  asymptotically  independent;  (3.1) 


«•  W.  ,  TO  W.  , 

r  M  ,  led-,  -  r  k+1 
l  io«n  +  -n— )  i  -  <1 

k=n  uk  d<=0  uk 


III.  .Joint  strong  approximation  for  record  and  inter- record  times 


THEOREM  2.  Without  loss  of  generality,  there  exists  on  the  same  probability 
space  where  {Un;  n  >_  0}  is  defined  a  unit-rate  Poisson  point  process  (T^; 
n  '  1}  and  a  non-negative  r.v.  2  possessing  all  positive  moments  with  mean 
I: ( Z )  =  1-C  such  that 


log  11  =  2  +  T  +  o(exp(-n+nH(-) ) )  a.s.  for  n  *  <*>, 


log  A  =  3+Tn+  log(l  -  expfT^  ^ -T^)  )+o(exp(-n+nil(pj-) ))  a.s.  for  (3.2) 

where  again  tH(^)  belongs  to  the  upper  class  of  a  Wiener  process.  The  rate 
result  cannot  be  improved  to  lower  class  functions,  not  even  if  o(.)  is 
replaced  by  of.)  in  (3.2). 


PROOF.  Summing  the  equalities  in  (2.11)  we  obtain 


lou  l,nd  ‘  F  Yk+1  =  l  l0S  1  +  jj  "H 
n  1  k=0  k  1  k=0  Uk+1 


a.s.  n  >  0 . 


Now  let 


T  =  j  Y,  for  n  >  1 ,  2  =  l  log  1  +  .-y 

•  I  i._  i  N  1  1 


.  \  1 


rom  relation  (2.3)  we  see  that 


with  1 


/Ilj.  <  expi-Tj.)  a.s.  from  which  it  follows  that  2  and  the  normal i: 


Poisson  process  (IT  -n)/v,;n;  n  >_  1}  are  asymptotically  independent.  Also, 
relation  (3.3)  shows  that  the  rate  of  convergence  in  (3.2)  is  exactly  determined 
hv  the  tail  series 


9 

no  IV  oo 

I  ~n —  I  e.xp(-Tj.)  a.?.  (3.6) 

k=n  k  k=n 

from  which  the  o(.)-result  follows  as  in  (7),  Theorem  2.  On  the  other  hand, 
h 

=  exp (log  hn+]  -  log  U  )  =  exp (0( log  n)  -  Tn))  a.s.  (n  -+  °°)  (3.7) 

n 

which  shows  that  the  rate  result  cannot  be  improved  to  lower  class  functions 
(cf.  the  proof  of  Theorem  4  in  Deheuvels  (2)).  For  the  proof  of  the  second 
statement  in  (3.2)  note  that  by  (2.10),  we  have 


'  1  11  . 1  V  ,  W  +  o(l) 

n+1  n+1  ,  n+1  ,  .  n+1 

=  U  1  =  e  ’  1  +  D - 

n  n  n 


a.s.  (n  -*-■») , 


hence 


log  'n+1  'log  Un  =  Vn+1  +  loR(1'c  n+1)  +  o(e'cn)  a.s.  (n  -+  «,) 


with  1  <  c  <  2  arbitrary  (but  fixedl. 

The  fact  that  E(Z)  =  1-f  follows  from  (1.12)  and  (3.5)  by  the  Dominated 
Convergence  Theorem.  This  proves  Theorem  2  completely. 


It  is  interesting  to  note  that  in  (3.2),  the  sequence  { -log(l-exp(Tn  ^-T  )); 
n  •  .'  ’>  is  i.i.d.  following  an  exponential  distribution  with  unit  mean,  which 
is  ef  order  0(log  n)  a.s.  for  n  -+  •». 


Iheotem  2  gives  a  unified  proof  of  all  the  limit  relations  (1.3)  to  (1.5)  and 
(l."  to  11.9),  even  for  the  exchangeable  case.  It  can  also  be  used  to  give 
complete  characterizations  for  the  upper  and  lower  class  of  the  record  and 
inter -record  times  as  in  Deheuvels  (2),  which  in  the  light  of  (3.2)  are  the 
same  as  those  for  a  unit  rate  Poisson  process.  Some  other  consequences  are 


listed  below. 


COROLLARY  2. 

{log  -  log  An;  n  _>  1)  is  asymptotically  i.i.d.  with  unit-mean  exponential 
distribution;  (3.10) 

{log  A  -log  U  n  >_  1}  is  asymptotically  i.i.d.,  the  asymptotic  distribu- 

_Y 

tion  being  the  same  as  that  of  W  =  Y  +  log  (1-e  )  where  Y  (and  hence  also 

_v 

-log(l-e  ))  follows  as  unit-mean  exponential  distribution,  giving  P.(W)  =  0 

and  Yar  (W)  =  tt1  (in  fact,  also  W  =  U  -  V  where  U  and  V  are  independent 
7~ 

doubly  exponentially  distributed  r.v.'s,  inplying  that  W  follows  a  logistic 
distribution  with  P(K  <_  x)  =  (1+e  x)  \  x  e  1R ) ;  (3.11) 

P ( LI  ■  iJ+e  A  i.o.)  =  0,  P (II  >  n^  £A  i.o.)  =  1  for  every  0<c<l;  (3.12) 
n  n  n  n 

P(An  >  sUn-i')  =  P(l0g  un'log  An<log(l+l/s))  -*■  y^~s  for  n  ^  °° 

and  every  s  >  0  (Galambos  and  Seneta  (3));  (3.13) 

there  is  no  sequence  {K  ;  n  >  1!  of  real  constants  such  that  U  /K  or 
A  /Kfi  follows  some  non- degenerate  limit  law  for  n  (Shorrock  (11), 

Tata  (13) ) ;  (3.14) 

(U  /II  j ;  n  >  0}  is  asymptotically  i.i.d.  with  U[0,1]  distribution 
(Shorrock  (11),  Tata  (13));  (3.15) 

U  +k  1 

■'  log  — ;  k  _>  1}  is  -  up  to  an  a.s.  error  of  magnitude  ofexp(  -n+nH(i-))  - 

n 

uniformly  close  to  a  unit  rate  Poisson  point  process.  (3.16) 

Of  course,  many  more  of  such  limit  relations  can  immediately  be  derived  from 
Theorem  2. 

finally,  relations  (3.10)  and  (3.11)  show  that  with  respect  to  the  normal 


approximation  of  record  and  inter-record  times  given  in  (1.4)  and  (1.8),  we 
have 


log  Wn  -  n 


log  A  -  n 


-  0(n 


1/2 


log  n)  a.s.  (n  -*■  ») 


(3.17) 


>^n  i/n 

which  cannot  be  improved  upon.  This  explains  why  for  small  or  moderate  values 
of  n  this  approximation  cannot  give  satisfactory  results. 


Concluding  remarks.  Obviously,  the  Poisson  processes  used  in  Deheuvel's 
representation  (1.13)  and  in  our  approach  (3.2)  are  not  the  same,  hence  Theorem 
2  does  not  give  joint  results  for  record  times  and  record  values  as  in  (1.16). 
However,  a  possible  connection  between  these  two  representations  can  be  seen 
as  follows. 

Let  (L  ;  n  >_  1}  be  the  i.i.d.  sequence  of  unit-mean  exponential  r.v.'s  forming 
the  increments  of  the  Poisson  point  process  used  in  (3.2).  Starting  with 
(1.13),  we  obtain 


log  A 


n+1 


-  log  A  =  T 


n+1 


T  + 
n 


(log  V 


n+1 


-  log  Vnl 


L 

=  -  log 


-1-; 


i-c  n)  +  (En+1  +  log  (1-e 


-E 


n+1 


)] 


(3.18) 


since  Tn+^-Tn  and  (log  Yn+^-log  V^}  are  independent  and  by  (3.11), 
log  Yn+1  -  log  Yn  =  En+1  +  log(l  -  e  n+1),  following  a  logistic  distribution. 
Rut  the  right  hand  side  of  (3.18)  is  just  (asymptotically)  the  increment  of 
the  logarithmic  inter-record  time  sequence  derived  from  the  representation  (3.2) 
In  the  light  of  relation  (3.18)  it  seems  impossible  to  establish  a  direct 
(strong)  relationship  between  the  different  Poisson  processes  involved,  unless 
constructions  as  in  (1.16)  are  considered. 
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